Dr V. Holiday 2023 Viewing Guide

Charles F. Vardeman II

Center for Research Computing, University of Notre Dame

2023-12-01

Goal: To help prepare you for those difficult holiday conversations…

How does ChatGPT work?

Karpathy: The busy person’s intro to LLMs

Karpathy LLM: YouTube Link

Reading List For Andrej Karpathy’s “Intro to Large Language Models” Video

Pay attention to the section on LLM security at the end of the talk.

Making LLMs “uncool”

Making Large Language Models Uncool Again: Youtube

Uncool “takeaways”

  • ~30b parameter models a missed opportunity
  • We are “fine-tuning” wrong
  • Uncertainty future directions for small (fine-tuned) vs large (API) models
  • LLM architecture not the path to AG(S)I

Deep dive into understanding LLMs

What is ChatGPT doing…and why does it work? Youtube

AI Engineering

OpenAI Dev Day LLM Performance Talk

A Survey of Techniques for Maximizing LLM Performance

Techniques for increasing LLM Performance

Model Consistency

Chen, Lingjiao, Matei Zaharia, and James Zou. 2023. “How Is ChatGPT’s Behavior Changing over Time?” arXiv. https://doi.org/10.48550/arXiv.2307.09009.

Model Consistency over time

Chen, Lingjiao, Matei Zaharia, and James Zou. 2023. “How Is ChatGPT’s Behavior Changing over Time?” arXiv. https://doi.org/10.48550/arXiv.2307.09009.

Mixture of Experts (MoE)

MoE

Patterns for AI Engineering

Building Blocks for LLM Systems & Products: Eugene Yan

Patterns for Building LLM-based Systems & Products

RAG in Production

Building Production-Ready RAG Applications: Jerry Liu

The need for “Guardrails”

Trust, but Verify: Shreya Rajpal

A “firewall” for your LLM

Trust, but Verify: Shreya Rajpal